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ABSTRACT 

This paper presents a control theoretic approach to modeling human response errors 
(HRE) in the flight simulation domain. The human pilot is modeled as a supervisor of a highly 
automated system. The synthesis uses the theory of optimal control pilot modeling for 
integrating the pilot’s observation error and the error due to the simulation model (experimental 
error). Methods for solving the HRE problem are suggested. Experimental verification of the 
models will be tested in a flight quality handling simulation. 

I. INTRODUCTION 

The use of flight simulator in pilot training is as old as flying itself. However, it was 
not until the late part of 1940s that the human pilot was considered as a part of the simulation 
model (ref. 3). In this respect, the human pilot is considered to be a complex servo-mechanical 
system whose position in the simulation loop represents that of a sub-optimal controller (ref. 1 , 

4, 5, 16). 

Control theoretic models have been shown to be very robust mathematical tools for 
modeling servo systems (ref. 5,7, 10, 17). Whether the human is modeled as an observer (ref. 

5, 6, 7), a controller (ref. 6, 8, 14, 21), a supervisor (ref. 9, 13), or a problem solver in fault 
diagnosis domain (ref. 12, 13, 17), the most important goal is to predict the human performance 
and behavior in a human-machine interaction system (ref. 12, 15, 20). 

The application of control model in the human pilot training simulation have been 
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promising and accepted as the conventional approach to modeling the pilot handling quality 
fidelity (ref. 6, 11). There is one important drawback in the current control models for flight 
simulators. That is, the performance of the model is based solely on the knowledge of the plant 
response before control is applied. In this sense, the human response error is a simplistic 
assumption of a Gaussian wide noise with zero mean and variance which depends on the plant 
dynamics. 

In this paper consideration is given to human response error (HRE) models which are 
additive components of both the model representation error and the experiment error 
respectively. The HRE models are conceptualized with generality in mind thereby allowing the 
simulationist the flexibility to experiment on a variety of flight handling quality (FHQ) tests. 
Methods for solving the HRE problem are suggested. 

Symbols 

a i i (i=o,i;j e {m, o}) characteristic gain function of the term in second-order error dynamic 

equation 

B m control vector for simulated model 

B r control vector for reference model 

C r coefficient matrix for the reference system output 

D r coefficient of error matrix for the reference system output 

d cardinality index 

E( • ) expected value operator 

e additive human response error term 

e m simulation model error 

e 0 observed model error 

e m expected latent error of expected input and conditional control 
F cost functional of least-square equation for e 0 
HRE Human Response Error 
i index (i -* o, 1) 

J 0 HRE cost functional 

j index operator, j e (m, o} 

K scaling factor 

L m ( • ) a function describing unknown dynamic input response 
M expected value of v 2 

m index for "model" 

N m (*) known part of system dynamics for the simulation model 


n cardinality index 

o index of observation in reference model 
P covariance matrix of error estimate 

U control vector for simulation model reference control vector 

U r control vector for reference model 

v error term 

R real number in Euclidian space 

r reference model index 

X m simulation model state vector 

X r reference model state vector 

Y r output vector from reference model 

Z m 0 response disparity distribution function 

ij m simulation error term described by neurodynamic function of the operator 
auto correlation function of x(t) 

^(oj) cross correlation function of x and y 
<£„(aj) power-spectral density of (t) 

0„(jo>) cross-spectral density of x(t) and y(t) 

H. THE HRE MODELING PROBLEM 

A. The optimal control model for HRE problem (OCM/HRE) 

The OCM/HRE system of interest are derived by the following dynamic equations, 

= X m (x,t) + L m (x,u,t) +J?(t) (1) 

where X e R“ is plant state vector whose components may represent aircraft dynamics such as 
velocity, flight path angle, and altitude; U e R“ is a control vector whose components may 
represent flap deflection, pitch roll angle, and elevator deflection; N m (x,t) is a known part of the 
system dynamics in the model before control is applied (i.e., the initial system state); 

L m (x, u, t) represent (the unknown response plant dynamics when the control vector u is applied, 
and rj(t) is e R " is an unknown disturbance vector or the neuromotor noise of he human pilot. 
The time variable t represents time. Equation (1) represents the OCM/HRE model. 

B. The classical OCM 

Following the classical optimal control model (OCM); see, e.g; Ref 5. Let us define a 
linear quadratic time invariant reference model which generates a desired trajectory (see ref. 2) 


K =A r X r + B r U r 


( 2 ) 


and the measurement 


= C r X r + D r U r 


(3) 
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is observed in the reference model r, where X r is the reference plant state vector, U r is the 
reference pilot control vector, Y r is the observed system output from the reference model (i.e; 
output vector utilized by the pilot in performing the control task). A, eR nra is a constant stable 
system matrix, B r e R nxd is a constant control vector and C r e R pxn and D r e R Md ; Y r e R p . Note 


that C r is a known matrix; 

Let v = D r U r (4) 

with E (v) = o (5) 

E(vv t ) = M ( 6 ) 


where M is a known p x p positive matrix. 

C. The HRE Model 

We are interested in modeling the response errors in the system. Starting from the 
reference model; let us suppose that we had an estimate of the state before the simulation 
(measurements) are made; which we will call X r , where 

E [(X r -X r ) {X-X) 1 ] = J (7) 

where J is a known n x n positive matrix. Observing equation (3) shows that Y r is a weighted- 
least-square of the estimate vector X. The usual criterion (ref. 2, 7) is a minimization of a 
quadratic form 
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F = 1/2[(X,-X r ) r .J-‘C X r -X r ) + (Y r -C r X r ) T M-'(Y r -C r X r )] (8) 

To determine X r , consider the differential of equation (8): 

dF = dxj [j" 1 (X r -X r ) -C r r M- l (Y r -C r X r )] (9) 


In order that dJ = 0 for arbitrary dx T r the coefficient of dx T r in equation (9) must vanish: 

(J--‘ + cl W 1 C r ) X f = J- 1 X r + Cl M- 1 Y r ) = (J- 1 + cl M- 1 C r ) X r + C r r M' 1 ( Y r ~C r X r ) 


X r = X r + P Cl M- 1 ( Y r -C r X r ) (10) 

Where P~ l = J-' + C 7 r M’ 1 C r (11) 


P is the covariance matrix of the error in the estimate X r , that we have 



P = E [(% r -X r ) (X-X r ) *] (11 b) 

Theorem 1: The observation error estimate e 0 - X r -X r (see ref. 2) . 
Proof : 

By adding and subtracting X r in the e 0 term we have 

e 0 = X r -X r + % r ~X r (12a) 


= X r -X r + PCl M' 1 [D r U r -C r (X r -X r )} (121?) 

Since X-X r and D r U r are independent , it follows equation (12jb) that 

E(e 0 el) = ( I-KC r ) J(I-KC r ) T + KMK T (13) 


and I is a unit matrix. 


(14) 


where K = PC r M' 1 

Premultiplying equation (11) by P and postmultiplying by J, we have 


J = P + PC ] M' 1 C r J (15) 

or P + (J - KC r )J (16) 

By using equation (16) in equation (13): 


E{e o e T 0 ) = P - P cjK T +KMK T = P - PCj M ~ l C r P + PC T r M" 1 C r P = P (17) 

Thus, we have established a model for observation error, e 0 in equation (12b and their 
computing properties in equations (13)-(17). 

We are now interested in establishing the existence of model error e m . To do this, we 
can introduce the command vector U(t) into equation (1). By rewriting equation (1) with the 


B m U m (t) component we have: 

X m =N m (x f t) + L m (X r U,t)-B m U m (t) + V(t) +B m C7 m (t) (18) 

X m = N m {x,t ) + Z m (x,U,t) + + 7, m (t) (19) 

where the term Z m (x,u,t) is defined by 

ZJx,u,t) =L m (x,u,t) - B m U m (t) (20) 


B m e is a known constant matrix of rank d selected from the experimental model. Next, we 
define a model error e m to be the difference between the plant state vector and the reference 


vector, 


( 21 ) 


e m = X m - X r 

Therefore the total human response error (HRE) comprises of the model error and reference 
error vectors respectively. That is 

HRE = e m + e o (22) 

11 m O 


D. Properties of HRE 

There various properties of HRE that need to be investigated experimentally. 

Case 1: If the model state vector X„ is absent, then e m = 0 thus, 

HRE = e 0 which is the classical method of state estimation. Thus HRE has all 
the properties discussed under section C above. 

Case 2: If the reference state vector X r is absent, then X m describes the synthetic 

simulation model whose validity is by experimental observation only. In this 
case HRE = e m . However, there is an error or experimental bias introduced by the 
difference between unknown (latent) response L m (x,u,t) and the input control 
B m U m (t) as defined by Z m (x,u,t) in equation (20). Let e* define this error such 


that 

= E [( Z m (x,u,t )] (23) 

Then, HRE = e m + <§ m (24) 


Case 3: If e m + e 0 = 0, then, we say that the simulation model described by X m has a high 
fidelity. This is never attained in reality. 

Case 4: The order of the system. 

From equation (21): — X^ - X r , and the time rate of change of the error e^, is 


X r (to), X m (0 given. Similarly; 


e = e + £ 

^ m o 


(26) 


is the time rate of change of HRE. Clearly, HRE can be modeled as a second-order system with 


( 27 ) 


the minimization criterion defined by 
= 1/2 ||e|| 2 


where e = HRE. 

Case 5: HRE is a second-order error dynamic system. This property follows directly from case 
4 above. Since e 0 and e m are independent, we can define the error dynamic equations 
by: 


e m = a < e „ 


+ ^ e m = 0 . 


(28) 


e 0 + a? e 0 = a° 0 e c 


= 0 , 


(29) 


Where a‘, (i = o, 1; j e(m,o}) is the characteristic gain vector associated with each 
system of equation. 

Case 6: L^fx^t) can be determined experimentally as follows: using the second-order gradient 
method, we guess a control parameter u(t=0) and determine X(t=0) from N m (x(t=0), 
u(t=0) =0, and then L m (X(0), u(0)). We can then determine the first and second 
derivatives of L m (x,u,t) with respect to u. Thus, we can approximate the (!!„, vs u)- 
curve by a quadratic curve: 


= L m (x 0 ,u 0 , 0) 


\dL m 

du 


(u-uj + 


\dL m 

du 


(U U g ) 2 ....( 30 ) 


Case 7: Time frequency property of HRE 

Previous human response models in the aircraft simulation domain have been described 
by Taylor (ref. 18, 19) in terms of time frequency and power spectrum density functions. In 
a particular case in which e m = e 0 , the autocorrelation function describing HRE is found by 

772 

¥>„( r) = ± f f 0 (t) fjt + r) at (31) 
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where f 0 (t) is fitted distribution describing the observation error, e 0 . In this case the power 


spectrum is 


t - 1 
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If e 0 ^ e m during the pericxi of observation T; 
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v»_Cr) - i f f.(t) IJt t r)dt (33) 

defines the crosscorrelation function of f 0 (t) and f m (t); and 

<P mo U “) = F m (n) F 0 (n) (34) 

where 

772 

FCnJF^n) = ^ | Exp{-j n u m )<P m 0 (r)dt (35) 


: m 



CONCLUDING REMARKS 

The discussion in this paper is geared towards modeling human response errors in a 
synthetic simulation domain in which flight handling qualities are the main tasks. The following 
conceptual contributions are prevalent to this paper. 

1. We model the HRE as a component of two types of errors: the model error constructed 
around the simulation domain; and the reference error which is the theoretical state space 
model commonly used. In addition, we introduce the concept of experimental latent 
error which is the disparity between the theoretical input vector and the human input 
response at a given state space. 


2. We discuss the various properties of HRE and their implications. 

3. We formulate a cost minimization model of a simulation environment interms of the 
HRE function. 

4. We demonstrate how the HRE model can be used in both the time and frequency 
domains. 

It should be noted here that the discussions in this paper needs further theoretical proofs 

as well as actual experimentation to warrant their applications in flight handling quality 

characterization. 
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